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^ ■ 1 Introduction 
T— I ■ 

^ ' In [1], a new approach was suggested to the construction of four dimensional Topological Quantum 

QJ • Field Theories (TQFTs) , proceeding from a new algebraic structure called a Hopf category. In [2] , 

Q i it was argued that a well behaved 4d TQFT would in fact contain such a category at least formally, 

l/^ I An approach to construction of Hopf categories was also outlined in [1], making use of the 

canonical bases of Lusztig et al [3]. This proceeded nicely enough, except that there was no natural 
truncation of the category corresponding to the case where the deformation parameter was a root 
of unity, so all the sums in the tornado formula of [1] were divergent. 

This situation is similar to what would have resulted if somebody had attempted to construct 
a 3d TQFT before the discovery of quantum groups. Formal state sums could be written using 
representations of a Lie algebra (or its universal enveloping algebra) but they would diverge. In fact 
■ such sums were written in a different context, as evaluations of spin networks [4]. The discovery 

of quantum groups made it possible to obtain finite TQFTs by setting the deformation parameter 



o 

(N 



equal to a root of unity [5] . 

^ ' The key to this progress is the theory of the deformation of Hopf algebras, as applied to the 

O^' universal enveloping algebras (UEAs) of simple Lie algebras. Infinitesimal deformations can be 

^ ! classified in terms of a double complex analogous to the complex which computes the Hochschild 

IT^ I cohomology of an algebra. Certain interesting examples, which lead to global deformations, cor- 

j_j ■ respond to Poisson- Lie algebras, or equivalently to Lie bialgebras, or Manin triples. Once the 



interesting infinitesimal deformations of the UEAs were known, it turned out to be straightforward 
to extend them to find the quantum groups, whence the 3d TQFTs followed. 

The purpose of this paper is to attempt an analogous procedure for Hopf categories. We begin by 
defining a double complex for a "bialgebra category," whose 3rd cohomology classifies infinitesimal 
deformations of the category. Next we apply this complex to the cases of finite groups and the 
categorifications of quantum groups produced by Lusztig [3]. We obtain suggestive preliminary 
results. 

Of course, an infinitesimal deformation is not yet a finite one. Still less is it a truncation. 
However, contrary to the folk adage, lightning tends to strike the same places over and over. The 
double complex we construct can also be used to compute the obstructions to extension of any 
infinitesimal deformation to a formal series deformation, so that at least a plausible avenue of 
research is opened. 

Let us remind the reader of the suggestion that 4d TQFTs may be the basis for a formulation 
of the quantum theory of gravity [6]. If this physical idea is correct, then 4d TQFTs from state 
sums should exist, and the program begun in this paper has a good chance of finding them. 

In any case, the deformation theory of categories introduced here is natural, and of intrinsic 
interest. 
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The contents of this paper are as follows: chapter 2 describes the complex which defines the 
cohomology of a tensor category, and relates infinitesimal deformations to the third cohomology. 
Chapter 3 describes the double complex for a bitensor category, and relates it to infinitesimal defor- 
mations of bialgcbra categories. Chapter 4 explores the construction of infinitesimal deformations 
in the most interesting cases. 

Let us emphasize that this paper has the purpose of opening a new direction for research. We 
pose many more questions than we answer. 



2 Cohomology and Deformations of Tensor Categories 

The deformation theory developed here is very similar in abstract form to the deformation theory of 
algebras and bialgebras. Perhaps the not so categorical reader would do well to study the treatment 
of that theory in [5] before reading this chapter. The main formal difference is that deformations 
appear in rather than H^. This is because in a category we deform associators, rather than 
products, and similarly for the rest of the structure. 

Unfortunately, it will not be practical to make this discussion self contained. The category 
theoretic ideas can be found in [7], while the definition of a bialgebra category is in [1,2,6]. 

In the following we consider the question of deforming the structure maps of a tensor category, 
that is an abelian category C equipped with a biexact functor : C x C ^ C (or equivalently an 
exact functor : C Kl C ^ C, where M denotes the universal target category for biexact functors) 
which is associative up to a specified natural isomorphism a : (8)((8) x 1) =^ (8)(1 x (g)) satisfying the 
usual Stasheff pentagon. A tensor category is unital if it is equipped with an object /, and natural 
isomorphisms p : — ® / =^ Idc and A : / (8> — =^ Idc satisfying the usual triangle relation with a. 

We will consider the case in which the category is if-linear for K some field, usually C. We 
denote the category of finite-dimensional vector-spaces over K by VECT. 

Definition 2.1 An infinitesimal deformation of a K-linear tensor category C over an Artinian 
local K -algebra R is an R-linear tensor category C with the same objects as C, but with Hom^{a, b) = 
Homc{a,b) (^K R, and composition extended by bilinearity, and for which the structure map(s) a (p 
and X) reduce mod m to the structure maps forC, where m is the maximal ideal of R. A deformation 
over K[e]/ < e""*"^ > is an n^^ order deformation. 

Similarly an m-adic deformation of C over an m-adically complete local K-algebra R is an 
R-linear tensor category C with the same objects as C, but with Hom^{a, b) = Homc{a, b)®KR, and 
composition extended by bilinearity and continuity, and for which the structure m,ap(s) a (p and 
X) reduce mod tn to the structure maps forC, where m is the maximal ideal of R. (Here (E)k is the 
m-adic completion of the ordinary tensor product.) An m-adic deformation over K[[x]] is formal 
series deformation. 

Two deformations (in any of the above senses) are equivalent if there exists a monoidal functor, 
whose underlying functor is the identity, and whose structure maps reduce mod m to identity maps 
from one to the other. 

Finally, if K = C (orR), and all hom-spaces in C are finite dimensional, a finite deformation 

of C is a K-linear tensor category with the same and maps as C, but with structure maps given by 
the structure maps of a formal series deformation evaluated at x = ^ form some ^ G K such that 
the formal series defining all of the structure maps converge at ^. 
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Ultimately our interest is in finite deformations, but their study and construction in general 
is beyond our present capabilities. In some particularly simple cases finite deformations can be 
constructed directly (cf. Crane /Yetter [11]). 

In the present work, we will confine ourselves to the classification of first order deformations, and 
consideration of the obstructions to their extensions to higher order and formal series deformations. 

To accomplish this classification, it is convenient to introduce a cochain complex (over K) 
associated to any K-linear tensor category: 

First, we fix notation for the totally left and right parenthesized iterates of ^ as follows: 

(g)" = (g)(l Kl (g))(l Kl 1 Kl (g))...(l Kl ...1 (g)) 
"(g) = (g)(g) K l)((g K 1 Kl l)...((g) H 1 H ...1) 

letting g)0 =0 (g = Idc- 

Now, observe that by the X-bilinearity of composition, the collection of natural transformations 
between any two functors targetted at a ii'- linear category forms a ii'- vector space Nat[F, G]. 
We now define the X-vector spaces in our complex by 

Thus elements of X"" have components of the form 

/Ai,A2,...,A„ : (-(^1 g) A2)... g) An) — > {Ai (g {A2 (g (... (g An)...)) 

In order to define the coboundary maps, and in much of what follows, it will be very convenient 
to have a notation for a sort of generalized composition of maps. To be precise, given some maps 
/i, /2, /fc all of whose sources and targets are variously parenthesized tensor products of the same 
word of objects, we will denote the composite 

OO o /l o «1 o /2 o ... o fkOCLk 

by [/i/2---/fcl where ao is the generalized associator from the fully left-parenthesized tensor product 
to the source of /i, Cj (for i = l,...,/c — l)is the generalized associator from the target of fi to 
the source of /i+i, and at is the generalized associator from the target of ft to the fully right- 
parenthesized tensor product. 

Except the fact that we need to include [ ] to obtain well-defined formulas familiar formulas 
define the coboundary maps for our complexes: 

If (/> G X", then 5\(l)) G is defined by 

n— 1 

'5(0)Ao,...,A„ = ® 0Ai,...,A„l + [^{-'^Y\(t}A^,...,A^<i^Ai+^,...An^] + \<pAo,...An-i® An^ 

i=l 

It follows from the coherence theorem of Mac Lane and the same argument which show the 
coboundary in the bar resolution satisfies 5^ = that these coboundaries satisfy 5"^ = 0. Thus we 
have a cochain complex associated to any K-Vmeai tensor category. We denote the cohomology 
groups of the complex by io*(C), where the tensor structure on C is understood, a 

^In cases where more than one iC'-linear monoidal structure is being considered on the same category, it would 
be necessary to use the notation S)' {C,®,oi) to distinguish the structures, since the group depends on the monoidal 
structure. 
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The significance of this may be found by considering the pentagon relation for infinitesimal 
deformations of the associator. 

If in the Stasheff pentagon giving the coherence condition on a, we replace all occurences of 
a with occurences of a + ea^^^ (where = 0), we find that the condition that the new Stasheff 
pentagon to commute reduces to 

(5(aW) = 

where a^^^ is considered as an element of X^. 

Thus, first order deformations correspond to 3-cocycles in our complex. 

More, however, is true: consider now equivalences of first order deformations. The main (only 
in the non-unital case) structure map has components of the form 

U®B + <^A,Be :A^B — > A^B 

where (f) is some natural endomorphism of (8). 

Now, suppose such a natural transformation defines a monoidal functor from a first order 

deformation with associator a + ae to another with associator a + be. Writing out the hexagon 
coherence condition for a monoidal functor, and evaluating the legs then gives 

OiA,B,C + {«A,B,C + (pA,B(g)C{<^A,B,c) + C^A <S) (t>B,c){aA,B,c)}e = 
OtA,B,C + {aA,B,c{4'A®B,c) + OlA,B,c{(t>A,B ® Ic) + bA,B,c}e 

Cancelling equal terms, solving for bA,B,c, and observing that the compositions with a are 
describing the operation of [ ] , we find that this is precisely the condition that 

b = a + S{(t)) 

Thus, we have shown: 

Theorem 2.2 First order deformations of a tensor category C,iS),a are described by 3-cocycles in 
the complex {X^,5}, and they are classified up to equivalence by the cohomology group ^)^{C). 

Let us now examine the obstructions to extending a first order deformation to a higher order 
deformation. 

Once again we begin with a commutative Stasheff pentagon, this time with legs given by com- 
ponents of a + a^^^e. 

Replacing these with corresponding components of o; + a^^^rj + a^'^^rf' (where rj^ = 0), and 
calculating as before gives us the condition that 

5(a(2)) = 

\^A^B,C,d'^a!b,C^d \ ~ r"A,B(giC,D(l^ "b,C,d)1 

Thus, the cochain on the right can be regarded as an obstruction to the extension to a second 
order deformation. It is unclear at this writing whether (or under what circumstances) this cochain 
is closed. 
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In as similar way, the condition needed to extend an n-th order deformation 

a(") = a + a^^h + ... + a^^-^^e""^ (e" = 0) 
to an n + 1-st order deformation 

a^'^+i) = a + a(i)r? + ... + a^^^)??" (7?"+^ = 0) 

is given by 

i + J = n + 1 
1 < i, j < n 

i + j = n + 1 
I < i,j < n 

i + j + k = 
n + 1 

1 < < 
n 

3 Cohomology and Deformations of Bitensor Categories 

A bitensor category is a ii'-linear abelian category C with two fundamental structures, a (biexact) 
tensor product (g) (equivalently, an exact functor CMC C ) , which is associative up to a natural 
isomorphism a which satisfies the usual Stasheff pentagon, and a tensor coproduct A which is an 
exact functor C ^ C MC which is coassociative up to a natural isomorphism (3 which satisfies a 
dual Stasheff pentagon, and moreover satisfies the condition that A is a monoidal functor, and ® 
is a cotensor functor (the dual condition), and the structural transformations are inverse to each 
other. We denote the "coherer", the structural transformation for A as a monoidal functor by n. A 
bitensor category is biunital when it is equipped with a unit functor 1 : VECT C and a counit 
functor e : C ^ VECT satisfying the usual triangle, dual triangle and conditions that they respect 
the cotensor and tensor structures, up to mutually inverse natural transformations. In the biunital 
case, we denote the counit tranformations by r and and the remaining stuctural transformations 
by 5 (counit preserves (8)), r (coproduct preserves /), and 77 (counit preserves /). 

A Hopf category is a biunital bitensor category equipped, moreover, with an operation on 
objects, 5, generalizing dual objects in a suitable sense. 

As in the case of a tensor category, it is the structural isomorphisms which we deform, subject 
to the coherence axioms. The isomorphisms are natural transformations between combinations of 
structural functors, so the terms in finite order (or formal series) deformations will live in collections 
of natural transformations between the functors, which are vector spaces in the case of iC-linear 
categories categories and exact functors. 

As we had done for (g), we fix notation for the totally left and right parenthesized iterates of A 
as follows: 

A" = (1K1...1K1A)...(1KA)A 
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A = (A K 1 K ...1)...(A M 1)A 



In order for us to place our deformation theory in a cohomological setting, it will be necessary 
first to examine the coherence theorem for bitensor categories (whether biunital or not). 

Fortunately, the structure is given in terms of notions for which coherence theorems are well 
known (monoidal categories and monoidal functors) or their duals. 

To state it properly, however, we require some preliminaries. First, we will restrict our attention 
to the case where all of our categories are equivalent as categories without additional structure 
to a category A — mod for A a finite-dimensional ii'-algebra. In this case C Kl P is given by 
A ®K B — mod when C (resp. V) is equivalent io A — mod (resp. B — mod). In this setting, 
the monoidal bicategory structure given by has pentagons and triangles which commute exactly 
(the structural modifications are identities), so the 1-categorical coherence theorem of Mac Lane 
applies, and we may disregard the parenthesization of iterated Kl, and the intervention of associator 
and unit functors. Thus we may use the notation C^" without fear of ambiguity. 

Second, we must note that if C is a bitensor category, so is C'^". The structure functors are 
given by applying a "shuffle" functor before or after the Kl-power of the corresponding structure 
functor for C. 

Theorem 3.1 (Coherence Theorem for Bitensor Categories) Given two expressions for 

functors from, an n-fold M-power of a bitensor category to an m-fold ^-power of the same 

category, given in terms of Id,®,I\^I,e^M, and composition of functors, (where the structural 
functors may lie in any ^-power ofC), and given two expressions for natural isomorphisms between 
these functors in terms of the structural transformations for the categories, identity transformations, 
Kl, and the 1- and 2-dimensional compositions of natural transformations, then in any instantiation 
of these expressions by the structures from a particular bitensor category, the natural isomorphisms 
named by the two expressions are equal. 

proof: First note that as in the corresponding from of Mac Lane's coherence theorem, we must 
deal with formal expressions for functors and natural transformations to avoid "coincidental" com- 
positions. 

The proof is reasonably standard: for any expression for a functor of the given form, we construct 
a particular "canonical" expression for a natural isomorphism to another such expression for a 
functor, then show that given two expressions for functors, and a natural transformation named by 
a single instance of a structural natural isomorphism, identity transformations, and 1-dimensional 
composition of natural transformations, the diagram of natural transformations formed by this 
"prolongation" of the structure map and the two "canonical" expressions closes and commutes. 

(The "canonical" has quotation marks, since it is only once the theorem is established that we 
will know that the map named by the composite is, in fact, canonical. A priori it is dependent 
upon the construction given.) 

Note that this sufflces, since 

1. by the middle-four-interchange law, any expression for a natural isomorphism of the sort 
described in the theorem will factor into a 2-dimensional composition of expressions of this 
restricted sort, and 

2. any composite of such expressions is then seen to be equal to the composite of the "canonical" 
expression for the source, followed by the inverse of the "canonical" expression for the target. 
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Our "canonical" expressions consists of a composite ci of instances of the structure maps k, 6, r, 
and r) to move all occurences of A and e "inside" all occurences of 0, and remove all applications 
of A or e to /; followed by a composite C2 of instances of /3, r, and / to remove all occurences of 
e applied to a cofactor of A and to completely right coassociate all iterated A's; followed by a 
composite C3 of instances of a, p and A to remove all instances of / tensored with other objects, 
and completely right associate all iterated (8)'s. 

Note that we have chosen an order to compose the three constituent composites, but have not 
specified the order within each composite. This is possible because C2 and C3 are each independent 
of the order by the coherence theorem of Mac Lane, and its dual, and the functoriality properties 
of lEl and the 1-dimensional composition of natural transformations; while for ci, the order of 
application is constrained by the nesting of the various functors, but within those constraints, the 
resulting composite is independent of the order by virtue of the functoriality properties of Kl and 
the 1-dimensional composition of natural transformations. 

In the circumstances of the theorem, we will let Cj (resp. c^) z = 1,2, 3 denote the components 
of the "canonical" map from $ (resp. 

We now have three cases 

Case 1 The natural isomorphism / from $ to is a prolongation of k, S, t, or 77. 
Case 2 The natural isomorphism / from $ to is a prolongation of /3, r, or /. 
Case 3 The natural isomorphism / from # to is a prolongation of a, p, or A. 

In Case 1, it follows from the same argument that shows that ci is well-defined that the targets 
of ci and c'^ coincide, and that c'^(/) = ci. 

In Case 2, by using the functoriality properties of Kl and the 1-dimensional composition of 
natural transformations, and the dual of the coherence theorem for monoidal functors, we can 
construct a natural isomorphism f- from the target of ci to the target of c'^ such that f is a 
composition of prolongations of /3's, r's, and Vs, and c[{f) = f'{ci). It then follows from the same 
argument that shows C2 is well-defined that the targets of C2 and c'2 coincide, and C2(/') = C2- 

Finally, for Case 3, by using the functoriality properties of lEl and the 1-dimensional composition, 
and the coherence theorem for monoidal functors, we can construct a natural isomorphism /' from 
the target of ci to the target of c'^ such that /• is a composition of prolongations of a's, p's, and A's, 
and Ci{f) = /'(ci). By using the functoriality properties of Kl and the 1-dimensional composition, 
and the naturality properties of prolongations of /3, r, and /, we can construct a natural isomorphism 
/" from the target of C2 to the target of C2 such that /" is a composition of prolongations of a's, 
p's, and A's, and C2(/') = f''{c2). It follows by the same argument that shows C3 is well-defined 
that the targets of C3 and C3 coincide, and d^if'') = C3. □ 

We shall call an instantiation of expressions of the type given in the previous theorem a pair of 
commensurable functors, and the unique natural isomorphism obtained by instantiating an expres- 
sion of the type in the theorem the commensuration. Given commensurable functors F and G, we 
will denote the commensuration by 7^'*^. 

Now, observe that A"("(8)) and [&]^hh[>A]^' = 0^.pA]^^ = [&]^^Ai are commensurable 
functors. Now, given a sequence of natural transformations /i, .•.,/« such that the source of /i is 
commensurable with A"("(8)), and the target of fi is commensurable with the source of /j+i, and 
the target of /„ is commensurable with [^^]^^ sh[' A]^^ let 
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denote the composition of the given natural transformations alternated with the appropriate com- 
mensurations. 

For any bitensor category, we can now define a double complex of vector spaces 
{X''*,d''* : X*'* X'+^'*,6''* : X''* X''*+^). 

Where X^^ is the space of natural transformations between the two (commensurable) functors 
and [^^J^-'s/ip A]^* from the i-fold to the j-fold tensor power of C to itself, where sh is the "shuffle 
functor" from [(7^i]^* to [(7^*]^^'. (Notice that because our category if A;-linear, these collections of 
natural transformations are A;-vector spaces.) And 



d{s) 

and 

6{s) 



l(l^s).MA«"(-)l + 



^(-l)^[r-^ K AK 1' 



u=i 



+ (-l)™+i[lS0"(sHl),;,(^B„(_)l 



\sh{lMs)nAmi-))] + 



i=l 



+(-i)"+ir®^™(s/i(sKi)i^„A(-))i 



in each case for s G X"'"* 

In the case of a biunital bitensor category, we can easily extend our complex to include the 
values of for i and j, interpreting as VECT, (8)° and °(8) as the functor /, and A° and °A as 
the functor e. 

It follows by a diagram chase from the coherence of the bialgebra category that (P = = 
dS + Sd = 0. Thus we have a bicomplex whose cohomology can be defined in the usual manner. 

Definition 3.2 The bicomplex described above is the basic bicomplex of the bitensor category. 
The total complex of the basic bicomplex, indexed by = 0j_|_j=„+iX*'-' is the basic complex of 
the bitensor category. 



Definition 3.3 The larger bicomplex described above is the extended bicomplex of a biunital 
bitensor category. 

Now we note that the three structural natural transformations of a bialgebra category live in 
the third diagonal of the basic bicomplex. Specifically, the associator a for the tensor product lives 
in X^'^ the coassociator /? for the coproduct lives in X^'^, and the "coherer" k lives in X^'^. The 
coherer is the isomorphism in a bialgebra category that corresponds to the axiom for a bialgebra 
which states that A{ab) = A (a) A (6). 

By an infinitesimal deformation of a bialgebra category we mean an infinitesimal deformation 
of its structural natural transformations which satisfies the coherence axioms to first order in the 
infinitesimal parameter, this makes sense because natural transformations are combinations of 
morphisms, and all the spaces of morphisms for our spaces are vector spaces. 

Concretely we let k' = k + ke,a' = a + ae, P' = P + be, for = 0. When we write out the 
coherence axioms for the new maps, we find the only new conditions beyond the coherence of the 
triple a, k, /? are 

d{a) = S{a) + d{k) = d{k) + 5{b) = 5{b) = 0. 

The deformations of our category (as a bitensor category) correspond to cocycles of the basic 
complex. Similarly, the equivalence classes of deformations under infinitesimal monoidal equivalence 
correspond to cohomology classes. 
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Theorem 3.4 The equivalence classes of infinitesimal deformations of a bialgebra category corre- 
spond to classes in the third cohomology of its basic complex. 

proof: Once it is observed that the structural maps for a bitensor functor are elements of X^'"^ and 
X^'^, it is easy to check (by writing out the hexagon coherence conditions for monoidal and dual 
monoidal functors) that a bitensor functor structure for the identity functor given over K[e\/ < > 
is described by a total 2-cochain which cobounds the difference between the two bitensor structures 
(as 3-cochains). 

(The fact that the third cohomology group appears here, rather than the second ala Hochschild, 
is suggestive in relation to the categorical ladder picture in TQFT. We know that a TQFT can 
be constructed from a finite group plus a cocyclc of the group. The cocyclc of the group must be 
chosen to match the dimension of the TQFT. Thus if a 2-cocycle of a bialgebra gives rise to a 3d 
theory, it is plausible that a 3-cocycle of a bialgebra category would generate a 4d theory. All this 
raises the question whether there is a classifying space of some sort for a bialgebra category whose 
cohomology is related to the cohomology of our bicomplex.) 

This theorem is not very useful in itself, since it docs not suggest a way to find interesting 
examples of cocycles. However, for a biunital bitensor category, we can embed the basic bicomplex 
into the extended bicomplex. Any element of on which 5 gives 0, or any element of X^'^ on 
which d gives can be pushed back into the basic bicomplex to give a candidate for a deformation. 
This is analogous to the process which led to the quantum groups: the classical r matrix lives in 
an extended bicomplex, and the vanishing of the analog of the Steenrod square of its differential 
is precisely the classical Yang-Baxter equation. See [5]. (Of course, the classical Yang- Baxter 
equation was not for any element of the complex associated to the Hopf algebra, but only to one of 
a very special form related to the Lie algebra. At the moment we do not know an analogous ansatz 
for the categorified situation. ) 

Thus, we now have an a pair of interesting new equations to investigate for Hopf categories : 

d{s) =0, s G X^'O {Dl) 
or 

5{t) =0, te {D2) 

In addition, we can ask about the equation which says that the infinitesimal defomration con- 
tracted from a solution to (Dl) or (D2) can be extended to a second order deformation. 

In the bialgebra situation, the combination of these two equations led to the classical Yang- 
Baxter equations, in the restricted ansatz. 

4 Searching for Deformations in some Interesting Cases 

A naive reader might suppose that the deformation equations Dl and D2 are rather disappointing, 
since they lead to a sort of cohomology of automorphisms of the identity or counit of the category. 
However, in the important cases, the unit and counit are not simple objects, so in fact we are led 
into interesting ground. 

In the case of the quantum double of the group algebra of a finite group, the identity is a sum of 
one ordered pair of group elements for each group clement. If we categorify in the natural way, so 
that each ordered pair of group elements is a simple object in the category, (see [11]) our equation 
Dl reduces to a cocycle on the group. In effect, we have reproduced Dijkgraf-Witten theory [9] 
in the language of deformed Hopf categories, since the group cocycle for Dijkgraf-Witten theory 
induces a finite (and thus) infinitesimal deformation of the Hopf category. 
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The other interesting case to apply our theory to is the categorification of the quantized UEA's 
constructed by Lusztig in his construction of the canonical bases [10] . In order to get a construction 
which worked for the entire QUEA, Lusztig was forced to replace the identity by a family of 
projectors corresponding to the weight lattice. (It must be cautioned that Lusztig only worked 
things out explicitly in the case of SL(2)). Thus the deformation equations translate into the 
coboundary equation for the complex for the group cohomology of the root lattice. This means 
that possible infinitesimal deformations of the bialgebra category correspond to 3-forms on the 
fundamental torus of the corresponding Lie group. We can see that even at the first order of 
deformation theory, our procedure seems to produce something only for certain Lie algebras- those 
of rank at least 3. Work is under way to examine the implications of the second order deformation 
equations in this situation. 

It seems unlikely that a complete deformation can be found order by order. Such an approach 
is too difficult even for bialgebras. Let us simply cite the fact [12] that it is an open question 
whether the vanishing of the obstruction to a second order deformation is always enough to ensure 
a deformation to all orders for a bialgebra. Nevertheless, our preliminary results suggest that 
deformations may exist for the bialgebra categories associated to certain special Lie algebras only. 
Whether this could bear any relationship to the special choices of groups which appear in string 
theory and supergravity is not clear at the moment, but the possibility cannot be ruled out. 

In order to clarify the situation, it will be necessary to find some global method for producing 
deformations. As of this writing, we have only begun to investigate the possibilities. Several lines 
of thought suggest themselves: 

1. One could search for a categorified analog of Reshetikhin's proof that every Lie bialgebra 
produces a quantum group [13]. In order to attempt this, we need to single out the part 
of the bialgebra category of Lusztig corresponding to the Lie algebra itself. This is rather 
delicate, since categories do not admit negative elements, but a way may be found. 

2. It is possible to examine special 3-forms on the groups F4 and Eq, related to their constructions 
from the triality of S0(8). Perhaps the relationships of these 3-forms with the structure of the 
Lie algebras will make it possible to extend the corresponding cohomology classes of the root 
lattices to complete deformations of the corresponding bialgebra categories. If so, the special 
Lie algebras for which we can produce bialgebra category deformations will be physically 
interesting ones. 

3. Lusztig constructed his categories as categories of perverse sheaves over flag varieties. The flag 
varieties are known to have q-deformations in the sense of non-commutative geometry [14]. 
Perhaps a suitable category of D-modules over the quantum flag algebras can be constructed. 



5 Conclusions 

Simple Lie groups and Lie algebras are very central constructions in mathematics. They appear in 
theoretical physics as the expressions of symmetry, which is a fundamental principle of that field. 
It has been a remarkable recent discovery that the universal enveloping algebras of Lie algebras, 
and the function algebras on Lie groups, admit deformations. This discovery came to mathematics 
by way of physics. 
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It is a further remarkable fact that the deformations of the universal enveloping algebras admit 
categorifications, i.e. are related to very special tensor categories. 

There is no reason not to try to see if this process goes any farther. The question whether the 
categorifications of the deformations can themselves be deformed is a natural one. 

The development in algebra we have outlined has had profound implications for topology, and 
at least curious ones for quantum field theory as well. Perhaps it is puzzling the the categories 
constructed by Lusztig do NOT seem to fit into the topological picture surrounding quantum 
groups. The direction of work begun in this paper has the potential of widening the topological 
picture to include Lusztig's categories as well. 

Finally, it seems that the relationship between topological applications of algebraic structures 
and deformation theory can be direct. One of us [15] has recently discovered a brief proof of 
a theorem generalizing the well-known result of Birman and Lins [16] that the coefficients of the 
HOMFLY and Kauffman polynomials are Vassiliev invariants. The proof makes a direct connection 
between the stratification of the moduli space of embedded curves in and the deformation theory 
of 6raided tensor categories (cf. Yetter [17]). It is plausible to suggest that the deformations we are 
attempting to construct may play a similar role. 
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